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EXPECTED  NUMBER  OF  STEPS  OF  THE  SIMPLEX  METHOD 
FOR  A  LINEAR  PROGRAM  WITH  A  CONVEXITY  CONSTRAINT 


GEORGE  B.  DANTZIG 


Abstract 


When  there  is  a  convexity  constraint ,  EXy  =  1,  each  iteration  t  of  the 
simplex  method  provides  a  value  Zt  for  the  objective  and  also  a  lower  bound 
zt — Wf  The  paper  studies  (1)  the  expected  behavior  of(wt/tv0),  (2)  probability  of 
termination  on  the  t^-  th  iteration ;  and  (3)  the  expected  number  of  steps,  (  ITER,  7  c 
when  the  columns  are  drawn  from  a  distribution  from  a  three  parameter  class 
of  distributions .  Using  estimates  based  on  a  random  like  behavior  for  covering 
simplices,  it  is  shown  that 

(ITER  <  m[2.8  +  iog,(Ma)  +  (2.8//)IogeW],  >  1, 

where  n  =  W+  m  + 1  is  the  number  of  non-negative  variables,  m  + 1  the  number 
of  equations.  0,  and  f  are  parameters  for  varying  the  distribution. 

Reasonable  bounds  are  1.5  <  $i$a  <  4.  The  critical  parameter  is  /  >  0. 

Poor  performance  can  be  expected  if  /  <  <  1.  For  0i#2  =  4,  and 


/  =  1  :  (ITER  <  4.2m  +  2.8m  log  ft , 


f  —  m/2  : 


(ITER  <  4.2m  +  5.5  log  W . 


It  is  conjectured  that  f  =  m/2  may  be  typical  of  practical  problems.  If  so,  for 
large  m  and  ff  <  some  fixed  multiple  of  m,  ( ITER  <  4.2  m  iterations  asm-*  oo. 
Tighter  bounds  for  m  <  5000,  n  <  4m  are  tabulat 
and  /  =  m/2,  (ITER  <  1.5  m. 


The  Approach 

Instead  of  viewing  linear  programs  as  a  single  class  of  problems  and  then 
applying  a  worst  case  analysis,  I  have  taken  the  view  that  they  should  be  classified 
by  the  characteristics  of  the  distribution  from  which  the  columns  are  drawn.  A 
special  class  of  distributions  with  three  parameters  0Ql  9i 02,  f  is  studied.  A  bound 
on  the  expected  number  of  steps  as  a  function  of  these  parameters  is  obtained. 
Given  a  linear  program,  one  could  use  its  input  data  to  estimate  values  for  0,- 
and  /  and  then  use  the  formulae  to  bound  the  expected  number  of  steps.  Much 
work  remains  to  find  a  good  way  to  characterise  linear  programs  encountered  in 
practice  and  to  develop  formulae  for  estimating  the  number  of  steps  as  a  function 
of  their  parameters. 

Each  step  of  the  simplex  method  with  a  convexity  constraint  produces  in 
the  space  of  the  columns  a  simplex  that  covers  a  point  b,  corresponding  to  the 
right  hand  side.  The  process  that  locates  5  relative  to  the  simplex,  is  viewed  as  a 
kind  of  black  box  out  of  which  pops  the  random  value  of  the  incoming  variable 
X#.  If  the  point  $  (as  expressed  by  its  barycentric  coordinates  in  the  simplex)  is 
uniformly  distributed  in  the  simplex,  then  p  =  1  — X,  has  the  density  distribution 
m  pm~ldp,  0  <  p  <  1  and  expected  value  X,  =  1  /(m  +  1). 

The  idea  is  illustrated  in  Figure  0.  Starting  at  top  left,  the  simplex  P1P2P& 
covers  the  origin  with  Fa  the  entering  column.  The  value  of  the  incoming  variable 
X,  is  00/(00  +  to).  Next,  top  right,  F#  replaces  Pi,  yielding  X,  =  01/(01  -f  61). 
Next,  at  bottom  left,  Fs  replaces  F3.  Then,  at  bottom  right,  F*  replaces  Fa. 
Note  the  'random*  behavior  of  the  origin’s  location  relative  to  various  simplices, 
particularly  the  value  of  X,. 

By  making  estimates  based  on  mpm~1dp,  we  can  bypass  the  difficult  (if  not 
intractable)  analysis  of  the  number  of  edges  (steps)  along  the  path  of  edges  in  the 
polyhederal  set  generated  by  the  simplex  method.  I  believe  this  distribution  leads 
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Geometry  of  the  Simplex  Algorithm 

The  problem  is  to  estimate  the  number  of  iterations  to  solve  by  the  simplex 
method  the  linear  program:  FIND  Xy  >  0,  minx 

n  n  n 

£  Pjlj  =  0,  £Xy  =  l,  £  ‘Ai  =  * 

J=*1  J=1  i- 1 

where  Fy  are  ns- vectors.  Because  of  the  convexity  constraint  a  problem  with  a 
general  right  hand  side  FyXy  =  J  may  be  reduced  to  the  above  by  setting 
Tj  ~  Pj  5.  A  general  linear  program,  i.e.,  one  without  a  convexity  constraint: 
FIND  xy  >  0,  minx  : 

n  n 

yi  = ejx3 = z> 

3- 1 

can  be  reduced  to  the  above  providing  one  is  willing  to  impose  an  upper  bound 
Af  on  the  sum  of  the  variables 

n 

yi  Xy  +  X»+i  =  Af. 

This  is  done  by  setting  xy  =  Af Xy, dividing  each  equation  by  Af,  and  then  setting 
Tj  =  Pj  -f  J/Af  as  above. 

Setting  aside  the  objective  function  x  for  the  moment,  the  vectors  Fy  may 
be  thought  of  as  points  scattered  around  the  origin  in  Rm  and  we  are  seeking 
weights  Xy  >  0  to  assign  to  the  points  so  that  their  center  of  gravity  is  the  origin. 
See  Figure  1.  Any  m  +  1  points  P»  whose  simplex  is  full  dimensional  (shaded 
area)  and  covers  the  origin  corresponds  to  a  basic  feasible  solution.  [In  a  different 
geometry  namely  the  space  of  (Xx,  Xa, . . Xn)  such  a  solution  corresponds  to  an 
extreme  point.]  Any  other  such  simplex  could  qualify  as  the  optimal  basic  feasible 
solution  if  its  corresponding  “cost”  coefficients  ey4  are  sufficiently  small  relative  to 
the  other  ey. 


4 


Rm  Space 


x 

X  p. 


FIGURE  1. 


The  simplex  method  has  two  phases.  Both  phases  use  the  same  procedure 
but  on  different  problems.  Phase  I’s  purpose  is  to  find  a  basic  feasible  solution  to 
start  Phase  II.  Phase  I  is  set  up  in  such  a  way  that  for  its  problem  a  starting  basic 
feasible  solution  is  at  hand  without  any  computational  effort.  The  two  phases  use 
the  same  algorithm.  We  will  therefore,  discuss  only  the  effort  to  solve  the  Phase 
II  problem. 

The  simplex  method’s  Phase  II  is  initiated  by  a  selection  (found  in  Phase  I) 
of  (m  1)  points  pit  with  two  properties:  first  that 


B  = 


1 


1 


is  non-singular  and  second  the  solution  to 


XXX. =°  .  XX  =  1  • 

i  i 

yields  X°t  >  0.  The  columns  of  B  therefore  form  a  basis  in  the  space  of  the 
columns  (Pj,  l)r. 
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The  basic  column  indices  are  denoted  by 

and  the  solution  Xj4  =  X°4  >  0  for  j  6  B  and  \j  =  0  otherwise,  is  called  a  basic 
feasible  solution.  The  value  of  this  solution  is 

m+1 

z  =  z0=  . 

*= 1 

The  iterative  step  consists  of  replacing  a  column  Pjr  by  P,  in  such  a  way  that 
the  two  properties  above  are  preserved  and  there  is  a  decrease  in  the  value  of  z. 
If  the  origin  is  in  the  interior  of  the  simplex,  the  decrease  is  strict.  If  this  happens 
on  each  step,  it  is  easy  to  see,  since  there  are  only  a  finite  number  of  simplices, 
that  the  process  is  finite.  However,  if  the  origin  is  on  a  lower  dimensional  face 
of  the  simplex  and  the  incoming  point  P,  does  not  replace  a  point  on  this  face, 
there  will  be  no  improvement.  In  such  a  case  it  is  necessary  to  use  a  perturbation 
scheme  to  get  around  the  “degeneracy”  in  order  to  guarantee  convergence  in  a 
finite  number  of  steps.  In  our  approach  the  columns  of  the  linear  program  are 
selected  at  random  from  a  distribution.  For  the  class  of  distributions  studied, 
the  probability  of  the  origin  lying  on  a  face  of  a  covering  simplex,  is  sero  and 
therefore  degeneracy  need  not  be  considered. 

Each  step  (iteration)  computes  (II,  xm+i)> 

DP*  +  JTm+l  =  Cjt  ,  ji  €  B 

This  system  is  solved  using  B— 1  which  is  updated  by  (m  +  l)3  multiplications 
and  additions.  Letting 


—  Cj  II.Pj  *Vn+l  t 
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the  incoming  column  P,  is  selected  by 


a  =  argminfy 

Note  that 

S,  <  6j  and  tfy4  —  0 ,  ji£  B  . 

It  is  easy  to  see  that  for  all  feasible  solutions  z0  +  6t  is  a  lower  bound  for  Z\. 
Indeed  if  St  >  0,  then  the  current  solution  zq  is  optimal  and  the  iterative  process 
stops.  To  prove  z0  +  £*  is  a  lower  bound: 

m-f-1  m-f-1  fw-f-l 

0  —  Sji X ^  ^  (cii  HPy4  *Vn-|-l)^y4  Vl  *™+l  ~~  ZQ  1 

$-.1  »=1  »=1 

n  it  » 

^  ^  Gj Xy  =  HPj  =  y  1  Cj\j  5Tm+l  —  Z  Zq 

i—i  i=  i  i=i 

Hence 

z  —  z0  =  6j\j  >  min  Sj  =  6,  ,  Xy  >  0 ,  E Xy  =  1 . 

Instead  of  plotting  Pj  £  Rm,  we  now  plot  (Py,  cy)  £  I?m+1,  see  Figure  2. 
The  problem  is  to  find  weights  Xy  >  0  so  that  the  center  of  gravity  lies  on  the  line 
(0, 0, . . .,  z),  which  we  will  refer  to  as  the  z  axis,  and  such  that  the  z  coordinate 
is  minimum.  The  hyperplane,  called  the  solution  plane,  that  passes  through  the 
points  (Pj,,  Cjt)  associated  with  the  basis  B,  has  for  equation 

IIP  +  JTm+l  =  Z  ,  tfm+l  =  ZQ 

where  (P,  z)  is  in  the  space  of  all  possible  columns  (Py,  cy).  This  plane  intersects 
the  z  axis  at  G  with  z  =  z0.  The  point  L  =  (P#,  c,)  selected  for  improvement,  is 
the  point  (Pj,  cy)  whose  absolute  distance  below  the  hyperplane  is  the  greatest. 

The  lower  bound  point  F  on  the  z  axis  with  z  =  zq-\- 6,  —  dt'xi  obtained 
by  passing  a  plane  parallel  to  IIP  *o  =  *  through  L  =  (P»,  c,)  and  finding 
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FIGURE  2: 

Improving  a  Basie  Solution 

where  it  cuts  the  z  axis.  Next  find  the  new  solution  plane  obtained  by  replacing 
(Pjr,  CjT)  by  L  —  [P,,  c,)  and  let  it  intersect  the  z  axis  at  if  at  z  =  Z\.  Join  L 
to  K  and  extend  until  it  hits  the  old  solution  plane  at  H.  The  lines  GH  and  LF 
are  parallel  because  they  lie  in  the  same  plane  and  at  the  same  time  they  are  on 
two  parallel  planes.  Therefore, 

GK  _  HK 
KF  ~  KL 

where  HK/{HK  +  KL)  =  value  of  incoming  variable  X,. 

We  now  project  parallel  to  z  axis  the  points  (Pj,  c})  onto  the  2  =  0  plane  and 
denote  by  T,TT,TI  the  points  corresponding  to  L,K,H.  The  point  K  projects 
into  "Kt  the  origin,  see  Figure  3.  Note  that 


FIGURE  3: 
Projection  onto  2  =  0 


GK  _HK  _  TTK  __ 

GF  HL  tk  *  * 

The  smaller  GF  =  ( — tf,)  and  Xg|  the  less  the  improvement  GK  because 


GK  =  X,(— 0,) . 


The  basic  solution  (X/lf  Xy„...,X/m+1)  is  also  the  barycentric  coordinates  of  K  in 
the  simplex  for  iteration  r.  If  P$  just  entered  replacing  PJr  then  P,  corresponds 
to  the  r-th  coordinate  and  X;-r  =  X,,  the  value  of  the  incoming  variable. 

Estimating  the  error  w*  after  t  iterations 

On  iteration  t  let  X*  be  the  value  of  the  t  —  th  basic  feasible  solution  and  let 
tt  —  wt  be  the  best  lower  bound  obtained  so  far.  Thus 


xt  >  minx  >  zt  —  wt  . 
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Initially  for  t  =  0,  we  have  given  z0  and  zo  —  x>o  =  min  cj.  On  iteration  t,  we 
generate  a  6,  =  ,  X,  =  X* .  Then 

zt+i  —  v>t+1  =  max(**  —  +  , 

becomes  the  new  best  lower  bound  generated  so  far.  Therefore  rearranging 
wt+i  =  zt+i  —  max(zt  —  wit  zt  +  O 

=  zt  +  \*,6,  —  ma x(zt  —  wtl  zt  +  tfj) 

=  — *J(— O  +  min(tw<,  —S\) 

<  wt(l  —  X*)  , 

where  X*  is  the  value  of  the  incoming  variable  in  the  basic  set  of  iteration  t  -f- 1. 

To  see  that  the  last  step  holds,  note  that  (1)  if  ( — 6\)  >  wt,  then  the  right 
hand  side  increases  as  (— S\)  decreases  towards  or  (2)  if  (— 6\)  <  wit  then 
the  right  hand  side  is  (— tf,)(l  —  X$)  and  it  increases  as  (— tf*)  increases  towards 
i ot.  Thus  the  maximum  is  attained  at  ( — 68)  =  It  follows  that 

«*+*  <  «f(i  -  xf.)(i  -  xt+1)-  •  (I  -  x5+*-1)  . 


Let 


9  — 


1 


-X 


3r  » 


then 


WT  <  pWr-l  —  (1  —  \jr)wT-l  • 


If  now  we  assume  with  equal  probability  that  the  incoming  column  Pt  cor¬ 
responds  to  any  vertex  t  in  the  simplex,  then,  letting  £(z)  stand  for  expected  value 
z  and  £(z  |  y)  for  expected  value  of  z  given  y, 


(p  =  ((1  -  \i)  = 


1  — 


1 

m  +  1 


m-f-l 

E  x<= 


i=i 


m 

m+T’ 


EX<  =  1, 
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independent  of  the  distribution  of  X<  in  the  simplex.  Therefore 
S(w*  |  wt-i)  <  [m/(m  +  l)]w«_i ; 

((wt  |  w*_2)  =  f[exp(«t>«/wt_i  j  |  wf_2] 

<  [m/(m  +  l)]f  [«*_i  |  wf_2]  <  [m/(m  +  l)]aw*_i . 

It  follows  inductively 

£ wt  <  [m/(m  -j-  l)]*«o  —  t~%lm  wo  • 

Estimating  At  =  (**  —  dt)  =  —  0*  after  t  Iterations 
As  developed  earlier,  except  now  At  in  place  of  — 

wt  >  z*  —  *t+ 1  =  X*  At . 

Therefore, 

At^WtX^1,  X,  =  X*. 

In  estimating  the  number  of  steps  we  set  aside  those  steps  in  which  X,  <  X* 
where  X*  =  p/{m  -f  1)  for  some  p  <  1  to  be  chosen  later.  Steps  with  X,  <  X* 
may  be  thought  of  as  “almost”  degenerate  pivots.  We  conservatively  estimate  for 
them  a  zero  improvement  even  though  in  fact  there  is  some.  Let 

P  =  Pr(Xa  <  X*) . 

To  estimate  P  as  a  function  of  p,  we  assume  the  location  of  ST  in  the  simplex 
is  uniform  over  the  simplex.  If  so  the  density  distribution  of  p  =  (1  —  X,)  is 
mpm~ldp.  This  randomization  assumption  is  consistent  with  the  earlier  one  in 
that  £  p  =  £(1  —  X,)  =  m/(m  -J-  1)  as  before.  We  now  have 

f>  =  Pr(X,  <  X*,)  =  f  m  pm—1  dfi=  1  —  (1  —  X|)m , 

*  * 

i-/j=d-x:r=(i--i7r 

-p  I 

—  {(1  _  _  1  )(m+l)//ty/tm/(m+l)  ±  e~fi 
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Thus  if  T  is  the  estimated  number  of  steps  with  X,  >  X*  =  1),  then 

'lT  =  T/(l-fi)  =  e^T,  n<  1, 

is  the  estimated  number  including  X,  <  X*.  What  we  will  do,  accordingly,  is 
to  bound  At  given  X,  >  X*.  It  is  to  be  understood  that  the  subscripts  for 
now  refer  only  to  those  steps  with  X,  >  X*,  skipping  over  the 
steps  X,  <  X*.  The  bounds  determined  for  the  expected  number  of  iterations 
with  X,  >  X*  will  later  be  corrected  for  the  omitted  iterations  with  X,  <  X*  = 
H /(to  4*  1)  by  multiplying  by  7  = 

Therefore  for  some  0  <  <  1, 

At  —  (1  ^r)Wr/Xt  ,  X*  >  Xg  . 

Earlier  we  showed,  except  now  Ar  —  —SI,  X,  =  XJ: 

Wr+i  =  — ArX,  +  min(wr,  Ar) 

=  —(1  —  <f>r)v)T  -}-  min(ior,  Ar)  <  4>rwr 

<  $T$T — 1*  *  • 

and 


> 

IA 

S-* 

1 

e- 

1 

1 

19 

/X*.  r>t,  0<^T<1. 

We  will  now  show  that  a  high  value  for  At,  i.e.,  <pt  close  to  0  implies  a  low 

upper  bound  for  At+i.  Indeed  this  is  clear  by  noting: 

At+a  < 

(1  —  ^t+a)&+i  it  ««/XJ 

At+i  < 

(1  —  •'♦A* 

At  < 

(1  —  ^t)wt/X,  . 
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Accordingly  our  approach  is  to  estimate  a  bound  for  by  averaging 

ar  =  Ar/wr  over  r  =  kt  k  —  1, . . . ,  t.  Denoting  the  average  by  we  will  use 
the  bound  for  ff*  es  the  smoothed  bound  for  a*.  By  definition 


-  —  *  V 


For  example  for  k  =  2, 


Sl+l  =  h^+^, 

2  wt+i  wt 


wt  >  v>t+i 


<  k— (i  -  *,+i)  h + -ki  -  *)k«.a:>  ,  o  <  ti  <  i 

2  W*+i  Wt 

<  5^-(»</x:)  • 

2  Wt+i 

Note  that  the  unsmoothed  bound  for  at+i  is  1/X*  whereas  the  bound  smoothed 
over  two  iterations  is  about  half.  Over  k  —  t  +  1  iterations  we  have 

1  *  i 

**  -  k~t  I  H  Wr  >  Wr+l. 

'  1  T=t  T 


The  values  of  4r  are  not  known,  so  we  choose  0  <  4r  <  1  so  as  to  maximise 
the  right  hand  side.  The  terms  with  indices  t  =  k  and  r  =  k  —  1  only  involve 
4k  end  4k— i  which  for  fixed  4k— 2,  ••  ■,4t  are  maximised  by  setting  4k  ==  0  and 
4k—  i  =  1-  The  second  term  dropping,  only  the  first  and  third  involve  4k— a 
and  are  maximised  by  setting  4k— 2  =  1*  Continuing  in  this  manner,  we  obtain 
4r  =  1  for  r  =  k  —  1, . . . ,  t  and 


_  ^  1  1  f\*\  —  »«/»» 

**  “  +  </X,)  (*-t+l)X;  ' 

Since  we  are  free  to  choose  k — t-f- 1,  the  number  of  ar  to  average.  Note  that 
(Wk  <  k)/m  •  wt.  It  is  natural  to  think  of  te*  as  being  roughly  proportional 
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to  *)/m.  If  so  the  smallest  bound  for  ft*  can  be  found  by  setting  to  sero  the 
derivative  with  respect  to  t;  the  min  is  attained  at  t  =  k  —  m-f-1.  It  is  more 
convenient  to  use  t  =  k  —  m.  Thus 

<  wk-m/[(m  +  1)X*]  =  Wk—m/n,  ft  =  (m  +  1)X* . 

We  will  use  this  bound  for  Hk  as  the  smoothed  bound  for  a*  =  A* /to*.  Thus 

A*  <  k>  m, 

when  k  >  m.  For  *  <  m,  ZF*  is  defined  as  the  average  value  of  A r/wr  for  0  < 
r  <  m  yielding 

A*  <  ii~lwk(wo/wm),  k  <  m, 
for  it  such  that  X*  >  X*  =  n!{m  -+■  1). 

Assumptions  About  the  Class  of  Distributions  of  Points  (P,  c) 

We  think  of  {Pj,  Cj)  as  a  random  sample  of  n  points  drawn  from  a  continuous 
distribution  of  points  (P,  c)  in  C,  a  convex  set.  Let  the  z  axis  intersect  C  at  lowest 
value  mins;  and  highest  value  max  z  and  let  d*  be  some  fixed  value  in  between. 
For  iteration  t,  the  solution  plane  is  U*P  +  zt  =  z.  The  point  {P,  e)  most  below 
this  plane  lies  on  a  parallel  hyperplane  that  touches  C  at  L  at  a  distance  A«  >  0 
below  it.  A  parallel  hyperplane  through  L  cuts  the  z  axis  at  d*  =  Zt  —  A«.  See 
Figure  4. 

For  any  hyperplane  IIP  +  d  =  z,  we  denote  by  Pr(fy  <  0)  the  probability 
of  finding  points  {P,  e)  below  the  hyperplane.  Suppose  we  move  the  hyperplane 
parallel  to  itself  from  a  value  d  =  dt  where  it  just  touches  C  from  below  at  L  up  to 
d  =  d*.  Our  assumption  about  the  distribution  is  that  its  cumulative  probability 
for  df  <  d  <  dt  is  bounded  as  follows: 

Pr(fi,  <  0)  <  tfol(d -  df)/(d* -dt)]',  0  <  $0  <  1,  /  >  0, 

14 


z  axis 

IX 


nax  z 


*  d^1  MiinT 


FIGURE  4:  {(Pj,  Cj)}  ii  a  aample  of  n  points 
from  a  distribution  of  points  [P,  c)  in  C 

for  some  choice  of  0o  and  /.  If  we  change  the  direction  II  of  the  solution  plane, 
dt  will  of  course  change.  We  are  assuming  that  a  fixed  $o  and  /  can  be  found 
independent  of  II. 

Case  C  is  a  ball 

For  example,  suppose  (1)  C  is  a  ball  in  m  -f  1  dimensions  of  unit  radius,  (2) 

the  distribution  of  C  is  uniform  in  the  ball,  and  (3)  the  center  of  the  ball  is  located 

on  the  z  axis  at  z  =  1.  Let  ip  be  the  angle  between  the  z  axis  and  the  normal  to 

the  hyperplane,  A  =  Acosyj,3  =  1  —  (1  —  d*)  coop,  and  finally  let  ?o  <  4  be 

•  * 

the  probability  of  being  in  a  spherical  cap  of  height  a  ,  then  for  A  <  a  <1, 


r*  r 1  ^ 

?T{Sj<0)  =  1oJo  (2z-z*r'*dz/ J  (2 z-z2)m'2dz, 

~\L  (2*  ~  *2)m/a<i*  if  (2*  -  z2)m/2dz . 

If  d*  is  very  small  we  can  ignore  the  z2  term  and  get  the  inequality 

Pr {Sj  <  0)  <  (A/d*)1+m/2 


i.e.,  /  =  1  +  m/2.  However,  d*  would  have  to  be  very  small  indeed  for  this  to 
hold.  For  hyper  spheres  of  dimension  m  1  <  21,1  have  computed  approximate 
values  of  the  integrals  and  find  that 


Pr (ffj  <  0)  <  (A/d*)m/2 ,  d*  =  .4 . 

I  conjecture  for  d*  <  .4  and  m-+  o o  that 

Pr(6j  <  0)  <  (A/d*)m/2“* ,  Jfe  >  0, 


where  ( k/m )  -+  0.  Even  if  this  is  not  true,  it  seems  intuitively  that  something  like 
/  =  m/2  should  hold.  The  rough  reasoning  goes  as  follows:  After  m  iterations 
one  could  safely  remove  from  C  all  points  above  say  HmP  -f-  2 zm  =  z  and  set 
d*  =  zm.  After  m  iterations,  d*  is  likely  to  be  suificiently  close  to  zero  that  one 
could  then  ignore  the  z2  terms  in  the  integration  as  above. 

Continuation  of  general  C  ease 

We  now  reexpress  the  bound  for  Pr(ffy  <  0)  in  terms  of  too,  *>*,  A*  =  z*  —  d*: 


Pr (#,  <  0)  < 


$o(zi  —  dj)? 

[{d*  —  zt)  +  {*t  —  d<)]f  ' 


<  Jo(*t  —  dt)f _ 

~  [(d*  —  min*  —  w*)  +  (**  — 


<  d0(l  +  (d*  —  minx  —  »«)/(*  —  d*)J  /. 
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Referring  to  Figure  5,  we  have  initially 


wo  —  zo  —  min  tj . 


Let 


max  z  —  nun  z 
d*  —  min  z 


*1  >  1 


max  z  —  min  e,- 

02  = - - — L  $2>1. 

max2  — mm2  ” 

Like  /,  $x  and  $2  are  characteristics  of  the  distribution  in  C.  Reasonable 
values  for  0i  and  82  might  be  1.5  <  8\  <  2.5, 1  <  82  <  2,  see  Figure  5.  High 
values  of  6,  give  rise  to  high  estimates  of  expected  number  of  steps.  For  illustrative 
purposes  8q  =  1  and  8i82  =  4  are  used  later.  Then 


or 


max  2  —  zq-\-  wq  ^  wq 

max  2  —  min  2  ~~  max  2  —  min  2  ’ 

(max  2  —  min  2)  >  two/02 


Therefore 

d*  —  min  2  =  (max  2  —  min  z)J8i  >  too/8i82  • 

It  follows  for  Zt  <  (C  that, 

Pr(tfy  <  0)  <  foil  ~h  {—wt  +  Wo/(^i  82)}/At]~'^ ,  At  —  Zt  —  dt . 

In  the  last  section  we  showed  that  if  we  consider  only  iterations  where  X,  > 
p/(m  -+■  1),  then  At/wt  had  smoothed  upper  bounds  n~~1v)t—m/v)t  for  t  >  m 
and  <  n~1Wo/wm  for  t  <  m.  Replacing  At  by  these  upper  bounds,  we  have  for 
t  such  that  zt  <  dt  : 

Pr {63  <  0)  <  0O[1  4-  +  «oo/(^i^2)>]—/ ,  t  >m 

<  *o(l  +  Wt  -f  voMMYr? ,  t  <m. 
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f(n+1  Space 


FIGURE  5: 

0o,  0i,02  are  characteristics  of  the  distribution  (P,  c). 

The  analysis  requires  a  bound  on  the  ratio  At/wf. 

Estimating  t  =  t0  :  zt  <  d*  for  t  >  t0. 

To  estimate  t0,  refer  to  Figure  5.  Note  that  Zt  <  d*  if  <  d*  —  min  *.  It 
therefore  holds  if 

U>t  <  wo/ (010a) 

because,  as  we  have  just  shown,  w o/(0i0a)  <  d*  —  minz.  Accordingly,  we  now 
estimate  a  t  =  t0  such  that 


Wf0  <  wo/(0i0a). 

Earlier  we  showed  £«/*  <  wo[m/(m-j-l)l*  ==  wq Therefore  on  the  •average* 


we  overestimate  such  a  t0  by  setting 


<  woe  *o/m  =  wo/(Ma), 

t0  =  mlog(Ma).  #<>1, 

which  henceforth  will  be  used  as  the  estimate  of  the  value  of  to  such  that  zt  <  d* 
for  t  >  to.  For  iterations  t  >  to,  we  first  determine  bounds  for  expected  iterations 
for  t  such  that  X,  >  p/(m  + 1)  and  then  we  multiply  these  bounds  by  7  =  to 
correct  for  omitted  iterations  having  X,  <  p/{m  +  1). 


Probability  of  Termination 

Given  n  points  (Pj,  Cj )  in  C  of  which  m-f-1  lie  on  hyperplane  TlP-\-zt  =  z,  the 
probability  that  none  of  the  remaining  if  =  n  —  (m-f  1)  lie  below  the  hyperplane, 
i.e.,  the  probability  of  termination  on  iteration  t,  given  non-termination  prior  to 
t,  denoted  Pr  (term),  satisfies 

Pr  (term)  =  [1  —  Pr (6j  <  0)J*  >  p< ,  ft  —  n  —  m  —  1 


where  we  have  just  shown 


Pi  =  {1  —  $ o  [1  -f  -f  wo/(wt_mMa)}]  f}w,  t  >  m 

P*  —  {1  —  *o[l  +  Pi— «W»o  +  rom/{vjt0i$2)}]~,}w ,  t  <  m , 

for  t  >  t0-  For  0  <  t  <  t0,  we  set  pt  =  0.  We  now  solve  for  w0/w*_m  if  t  >  m 
(or  wm/wt  if  t  <  m)  in  terms  of  p  =  pt : 


1  top 
Ma  *>t-m 

1 

0102  Wt 


A*  V>t—m 

A*  Wo 


t  >  m 


t  <m. 


-44- '• .  •.  .4.  1  r 
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The  value  of  t  given  p  will  be  estimated  by  trying  to  find  a  t  >  to: 


1  .  wo 
Ma  ?  w«-m 

$l$2  *  *>t 


-vlf'/ii  -  - 1] + f-S- , 

P  Vt—m 

i[«y,/(i-pi/w)w-ii+«^, 

P  w0 


t  >  m, 


t  <  m. 


Recalling  £(to,/«/y)  <  e~(*  for  z  >  y,  we  have 
£[l/(w*_m/w0)]  >  l/f(w«-m/w0)  > 

also  ((wt/wt—m)  <  e~1.  We  proceed  in  a  similar  manner  for  the  t  <  m  case. 
Either  case  yields 


1  e(*-m)/m  <  Ipj ///(i  _  pi/a)i//  _!]  +  e-1 . 

*1*2  0 

Whence  substituting  e*°/m  =  $\$2, 

e(t— «o)/m  <  [tfV//(l  _  pl/Wjl//  __  (i  _  ^  e— 1 ,  t  >  t0,  p  <  1 . 


We  overestimate  t,  the  number  of  iterations  to  obtain  a  probability  of  termination 
>  p  on  iteration  t,  by  setting  LHS  =  RHS  above.  Letting  »  —  t  —  to  and  t  =  t? 
corresponding  to  p  =  pt,  we  have  solving  for  sp, 

•p  =  m  \og{tl/f/{l-pl/*)1/f  - (1  —  pt"1)}  +  m  log (ep-1),  p<l. 

The  smallest  allowed  value  of  »p  is  »p  =  0  and  this  occurs  when 

P  =  Pu  =  (l  —  *of. 

In  other  words  a  probability  of  termination  p  >  (1 — 8q)k  on  some  iteration  to+s 
(where  «  used  here  is  not  to  be  confused  with  incoming  variable  P«),is  attained 
on  the  "average”  for  t  <  to  +  'ftp. 


Therefore  iteration  t  =  Tp  corresponding  to  a  probability  of  termination 


P>(1 -*<))*: 


Tp  —  t0  +  7 sp  =  m  logfMa)  +  7**,  7  =  • 

For  p  >  .8*,  we  can  use  the  very  close  approximation 

(1  -p*'”)  =  -log|l  -  (1  -p1/*)]  =  -(1/H)l0f  P,  .8  <  p1'*  <  1 . 

Thus  for  p  >  (1  —  0o)K  and  p  >  .8*, 

sp  =  m  log(e fi~l)  +  m  log[{— M/log  p}1/f  —  (1  —  pe-1)] . 

Suppose  m  =  1000,  —  m  —  1  =  1000,  /  =  1  or  /  =  m/2,  0O  =  *5, 

03  =  4.  How  many  iterations  t  =  T.oi  must  be  performed  before  the  probability 
of  nontermination  on  iteration  t,  with  X,  >  .14/(m+ 1),  is  less  than  1  — pt  —  .99! 
This  means  termination  is  likely  within  another  1/pt  =  100  additional  iterations. 
Noting  n  =  .14, 7  =  =  1.14,  substitution  in  the  above  formulas,  gives  p  > 

(1  —  0o)*  and  .8*  so  it  is  okay  to  use  the  approximation  for  s.oi  which  gives 
T oi  =  (1.4  +  7.7 7)m  =  10.1  m  if  /  =  1  or  T.oi  =  (1.39  +  .0177)m  =  1.59  m 
iterations  if  /  =  m/2. 

The  inverse  function,  obtained  by  solving  for  p  =  p*  in  terms  of  ap  =  a, 
Pr(term)  >  p*  =  {1  - *o[l  +  M e_1(-l  +  ea/m)]~f}K,  *  =  t-to>0, 

will  be  needed  later. 
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Expected  Number  of  Iterations 

If  pt  is  the  true  probability  of  termination  on  step  t,  =  1  —  pt  and  — 
7o '  7i* '  *9«i  then  the  expected  number  of  iterations,  by  definition,  is 

£  ITER  =  0  •  p0  -j-  1  •  <5o  *  Pi  ~h  2  *  QoPa  H - h  tQt—iPt  H - 

=  9o  +  9o9i  +  9o9i9a  H - h  <7*  H - 

Since  pt  <  Pt,  the  expected  iterations  beyond  t  —  1  is  less  than 

<J(t)(l  +  <jrt+i  H-  qt+iqt+2  -f-  qt+iqt+aq*+s  H - )  , 

where  qt  =  1  — p*  and  Qt  =  q0  qi . qt •  Because  pt  <  p*+ 1  <  •  •  •»  the  above 

is  less  than 

«(<)(!+?.+ 9? +■)= m/m ,  Qm  <  i . 

It  follows  that 

Lemma:  Expected  number  of  iterations,  (ITER  <  to  +  7 [sp  +  (1/p)]  where 
7  =  eM  is  the  adjustment  so  as  to  include  iterations  having  \,  <  \*  —  p/(m-f-l) 
and  0  <  p  <  1. 

Therefore  for  any  p,  (1  —  fo)*  <  p  <  1, 

(ITER  <  mlog(fifa)  +  7mlog(ep'"1) 

+  7  m{log[{f0/(l  -  pl/*)}l/f  —  (1  —  fie~1)]  +  l/pm> . 

A  weaker  bound  can  be  obtained  by  dropping  the  (1  —  pe— l)  term: 

For  any  p  >  (1  —  #0)*, 

(ITER  <  m  log(M2)  7  m{log(e  p-1)  +  j  log  #0  —  y  log(l  —  plf*)  +  1/pm)} . 
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At  this  point  we  derive  some  asymptotic  results.  Assume  n  fixed  as  m  ->  oo. 

Set  p  =  (1 — 0o)*  and  note  1  /(pm)  -►  0.  We  have,  using  the  stronger  upper  bound 
above 


£ITER  <  m  log^^)  for  m  -*  oo  and  n  fixed,  9X92  >  1. 

For  example  £ITER  <  1.4  m  when  9X92  =  4.  Assume  instead  m  ->  oo  and 
W  -♦  oo,  then  for  any  fixed  p  and  W  sufficiently  large:  (1  —  0O)*  <  p.  Again 
l /{pm)  -*  0.  We  can  fix  p  arbitrarily  small  providing  1 1  large  enough  —  hence 

log(l  —  P1/w)  =  —  logn  +  log(-logp)  =  —  logH  +  b  where  6  can  be  fixed 
arbitrarily  large.  Therefore, 

£ITER  <  m  log(0i02)  +  7m{l°g(eM— j log 90  -f  jlogJi— 

where  1  <  7  <  « ,  m->  oo,  n  ->  oo  and  6  >  0  fixed  (arbitrarily  large). 

Our  objective,  however,  is  not  to  get  asymptotic  bounds,  but  bounds  for 
£ITER.  Note  any  p  >  (1  —  90 )*  can  be  chosen.  Choose  p  =  e~i.  Since 
7  <  e,  the  term  1  /(pm)  can  be  dropped  with  an  error  in  the  bound  for  { ITER  < 
2.77  <  10  iterations,  actually  less  since  earlier  we  set  Q(t)  =  1.  Note  also 

log  W  =  log(l  e  1/w).  The  condition  p  >  (1  —  9o)n  becomes  $off  >  1. 
Therefore 

^ ITER  <  m  log(Ma)  +  7m{log(e/*-1)  +  j  Iog0o  +  j  logW} 

=  mpog(Ma)  +  eM{l  +  ~  log  90lf  —  log/*}] 

=  mPog(^tfa)  +  E) ,  9X92  >  1,  90n  >  1 . 

As  a  final  step  we  determine  p  and  7  =  e'*  so  that  the  bound  for  E  is  as 
small  as  possible.  Note  that  E  is  of  the  form  e*(A  —  log/*)  where  p  <  1  and 
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.  1 


A  =  1  -f-  /— 1  logfl*  >  1-  Setting  dE/dp  —  0,  we  obtain  p  as  the  solution  of  the 
equation 

A=(l+p\ogp)p~l . 

Once  p  is  obtained  as  a  function  of  A,  we  also  hare 

E  =  e^p-1 ,  7a  =  E/A  =  cM/(l  +  p  log  p) . 

Corresponding  values  of  A,  7a,  p,  c^*,log/i  tabulated  below. 


log/i 

P 

A 

7a 

0.0 

1.00 

2.72 

1.00 

2.72 

-0.5 

.61 

1.83 

1.14 

2.65 

-1.0 

.37 

1.44 

1.72 

2.28 

-1.5 

.22 

1.25 

2.98 

1.88 

-2.0 

.14 

1.14 

5.37 

1.57 

q 

CO 

1 

.050 

1.05 

19.09 

1.23 

0 

1 

.018 

1.02 

50.60 

1.10 

-00 

.0000 

1.00 

+00 

1.00 

Therefore,  finally, 

£  ITER  <  mlog(Ma)  +  7a  n*[l  +  j  log(*oW)l , 
where  0x0a  >  1, 901S  >  1  and  1  <  7a  <  7a  i»  found  in  the  table  above  using 

A  =  1  +  j  log(*0W)  • 

A  better  bound  for  the  expected  number  of  iterations  can  be  computed 
directly  from  the  formula 

(ITER  <  to  +  7(9*o  +  9*o9*o+i  H - +  9to9*o-M  *  *  *  9r)  »  9 *  =  1  —  Pt, 
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where  the  series  is  truncated  at  t  =  T  such  that  Qt/Pt  <  1  where  Qt  —  Qo'“  Qt- 
The  truncation  error  is  less  than  7  =  t*%  0  <  p  <  1.  These  bounds  on  the 
expected  number  of  iterations  have  been  computed  and  are  given  in  the  tables 
that  follows  for  various  m  and  n  and  for  /  =  1  and  /  =  m/2  for  comparison. 
Reasonable  values  for  0j  are  .5  <  $o  <  1»  1.5  <  &i&2  <  4.  The  values  of  $i  used 
are  $0  =  1,  $162  =  4.  See  Table  1  for  /  =  1  and  Table  2  for  /  =  m/2. 
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FORMULAE  USED  TO  COMPUTE  TABLES 

Given  m, »  >  m  +  1  and  parameter!  associated  with  the  distribution  from 
which  the  columns  are  drawn: 

0  <  l0  <  1 ,  Ma>l,  /  >  0. 

Determine  W=»  —  m  —  1.  If  0qJI  <  1,  set  lo  =  1/w  so  that  loW  >  1. 

To  compute  p  and  riA' 

A=l  +  (l//)log,(M). 

Find  it  <  1: 

A  =  (H-Ailogf/i)/p 
7a  =  e»/(Ait) 

Crude  Bound  =  to  +  7 A  Am  -f-  eM+l  where  to  =  mlog4(lila). 

Probability  of  termination  on  iteration  t  >  pt  with  X,  >  p/(m  +  1): 

Pi  —  0 ,  0<t<to 

Pt  =  {1  -  loll  +  1  +  t  =  to  +  •  >  to 

qt  =  l—pi\  Qt  =  <7t0  •9t0+i---<7t; 

Bound  =  to  +  eM(Qt0  +  Qto+i  H - H  Qt)-  •  •  terminate  when  Qt  <  pt. 


TABLE  1:  /  =  1 

BOUND  ON  EXPECTED  NUMBER  OF  ITERATIONS 
AS  A  MULTIPLE  OF  THE  NUMBER  OF  EQUATIONS  —  1 
parameter  value i  /  =  1,  0o  =  1,  0i$2  =  4 


m  -f-  1  = 
number  of 
equations 

n  =  2m 

n  =  Number  of  Variables 
n  =  2.5m  n  =  3m  n  =  3.5m 

n  =  4m 

Crude 
Bound/m 
n  =  4m 

m  —  2 

4.8 

5.1 

5.7 

6.2 

6.4 

8.2 

m  =  5 

5.4 

6.2 

6.7 

7.0 

7.3 

8.4 

m  —  10 

6.3 

6.9 

7.3 

7.6 

7.9 

9.0 

m  =  20 

7.0 

7.6 

8.0 

8.2 

8.5 

9.6 

m—  50 

7.4 

8.4 

8.8 

9.1 

9.3 

10.6 

m  =  100 

8.6 

9.1 

9.4 

9.7 

9.9 

11.3 

m  —  200 

9.3 

9.7 

10.0 

10.3 

10.5 

12.1 

m  =  500 

10.1 

10.6 

10.9 

11.1 

11.4 

13.1 

m  =  1000 

10.8 

11.2 

11.6 

11.8 

12.0 

13.9 

m  =  2000 

11.4 

11.9 

12.2 

12.5 

12.7 

14.7 

m  —  5000 

12.3 

12.8 

13.1 

13.1 

13.3 

15.6 
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TABLE  2*  /  =  m/2 

BOUND  ON  EXPECTED  NUMBER  OF  ITERATIONS 
AS  A  MULTIPLE  OF  THE  NUMBER  OF  EQUATIONS  -1 
parameter  values  /  =  m/2,  do  =  1,  dtfz  =  4 


m+  1  — 
number  of 
equations 

n  =  2m 

n  =  Number  of  Variables 

n  =  2.5m  n  =  3m  n  =  3.5m 

n  ssb  4m 

Crude 
Bound/m 
n  =  4m 

m  =  2 

4.8 

5.1 

5.7 

6.2 

6.4 

8.2 

3 

II 

Vt 

4.0 

4.5 

4.8 

5.1 

5.2 

6.5 

m=  10 

3.5 

3.8 

4.0 

4.2 

4.3 

5.6 

m  =  20 

3.0 

3.2 

3.3 

3.4 

3.5 

5.1 

m  =  50 

2.3 

2.4 

2.5 

2.5 

2.6 

4.6 

m=  100 

2.0 

2.0 

2.1 

2.1 

2.1 

4.4 

m=  200 

1.7 

1.8 

1.8 

1.8 

1.8 

4.3 

m  =  500 

1.8 

1.7 

1.6 

1.6 

1.6 

4.2 

m  =  1000 

1.5 

1.5 

1.5 

1.5 

1.5 

4.2 

m  =  2000 

1.4 

1.4 

1.4 

1.4 

1.4 

4.1 

m  =  5000 

1.4 

1.4 

1.4 

1.4 

1.4 

4.1 

28 


Acknowledgment!: 

I  am  indebted  to  Norman  Zadeh  for  his  insights  which  made  this  paper 
possible.  His  intuition  as  to  why  the  simplex  method  is  efficient,  stimulated  me  to 
go  back  to  my  original  formulation  to  see  if  it  was  amenable  to  analysis.  Michael 
Klass  and  Michael  Taksar  gave  valuable  advice  on  the  randomisation  model.  I  am 
also  grateful  to  Richard  Stone  who  drew  my  attention  to  some  logical  errors  in 
an  earlier  draft  of  this  paper.  Brian  Leverich  wrote  the  program  for  calculating 
the  table  of  expected  number  of  iterations  for  various  m  and  n. 

Finally  a  special  acknowledgement  to  Alan  Hoffman  for  his  critical  review  of 
the  analysis  and  his  suggestions  for  keeping  the  proofs  as  free  of  special  assump¬ 
tions  as  possible. 


29 


References 


[1]  BORGWARDT,  K.H.,  “Untersuchungen  zur  Asymptotik  der  mittleren  Schritt- 

sahl  von  Simplexverfahren  in  der  linearen  Optimierung,”  Operations-Reseach- 
Verfahren,  Band  XXVIII,  (1977),  pp.  332-345;  summary  of  dissertation. 

[2]  BORGWARDT,  K.H.,  “Zum  Rechenaufwand  von  Simplexyerfahren,”  Opera- 

tions-Reseach-Verfahren,  Band  XXXI,  (1978),  pp.  83-97. 

[3]  DANTZIG,  G.B.,  Linear  Programming  and  Extensions,  Princeton  Uniyersity 

Press,  1963,  pp.  160-166. 

[4]  DUNHAM,  J.R.,  D.G.  KELLY,  AND  J.W.  TOLLE,  “Some  Experimental 

Results  Concerning  the  Expected  Number  of  Phrots  for  Solving  Randomly 
Generated  Linear  Programs”.  TR  77-16  Operations  Reseach  and  Systems 
Analysis  Department,  Uniyersity  of  North  Carolina  at  Chapel  Hill,  1977. 

[5]  HOFFMAN,  A.J.,  M.  MANNOS,  D.  SOKOLOWSKY  and  N.  WIEGMANN, 

“Computational  Experience  in  Solying  Linear  Programs,”  J.  Soc.  Indust. 
Applied  Math.,  Vol.  1,  No.  1  (1953),  pp.  17-33. 

[6]  KLEE,  V.,  “A  Class  of  Linear  Programming  Problems  Requiring  a  Large 

Number  of  Iterations,”  Mathematics  of  the  Decision  Sciences,  Part  1  (G.B. 
Dantzig  and  A.F.  Veinott,  Jr.,  eds.),  AMS,  1968. 

[7]  KUHN,  H.W.  and  R.E.  QUANDT,  “An  Experimental  Study  of  the  Simplex 

Method,”  Proceeding  of  Symposia  in  Applied  Mathematics,  Vol.  XV,  AMS 
(1963). 

[8]  LIEBLING,  T.M.,  “On  The  Number  of  Iterations  of  the  Simplex  Method,” 

Methods  of  Operations  Research,  XVII,  V.  O berwolf ach- Tagung  uber  Opera¬ 
tions  Research,  13-19  August  1977,  pp.  248-264. 

[9]  ORDEN,  A.,  “Computational  Inyestigation  and  Analysis  of  Probabilistic  Param¬ 

eters  of  Conyergence  of  a  Simplex  Algorithm,”  Progress  in  Operations  Research, 
Vol.  If,  (A.  Prekopa,  ed.),  North  Holland  Publishing  Company,  Amsterdam- 
London  (1976),  pp  705-715. 

[10]  WOLFE,  P.,  CUTLER,  L.,  “Experiments  in  Linear  Programming,”  Recent 
Advances  in  Mathematical  Programming,  R.L.  Graves  and  P.  Wolfe,  eds., 
McGraw  Hill,  1963,  pp.  177-200. 

[11]  ZADEH,  N.,  “What  is  the  Worst  Case  Behavior  of  the  Simplex  Method,” 
Operations  Research  Department,  Stanford  University,  draft,  (March  1980). 


30 


UNCLASSIFIED _ 

security  classification  of  thi«  rape  /*Mr  Qmm  «»ww< 

REPORT  OOCUMEHTATIOH  PAGE 

'I  Ji&iooS  numIcJT  . .  is.  oovt  accmmon  no. 

'J  S0L-8^.3R^  A  A  ML 


READ  msntUCTKWS 
BEFORE  COMPLETPCO  FORM 

>  RECIPIENT  S  CATALOG  NUMtf  A 


Title  tm>4  tutuu*) 


PECTED  JUJM8ER  OF  .STEPS  OF  THE  SIMPLEX 
JHOD  FOR  ALINEAR'TROGRAM  WITH-* 


MJHOD  FOR  A  LINEARTfROGRAM  WITH-* 
jlONVEX ITY  JMNSTRAINfr 

AUTMORTaJ 


George  B.^DantzIg 


t.  *E*ro«MING  ORGANIZATION  NAME  AND  AObftCSt ” 

Department  of  Operations  Research  -  SOL1' 
Stanford  University 
Stanford,  CA  94305 

"  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

Operations  Research  Program  —  ONR 
Department  of  the  Navy 

_  800  N.  Qulncv  St..  Arlington.  VA  22217 - 

it.  monitoring  agency  name  a  aodrcsvi/  WhtSU  ni  CaiMmj  OMnj 


S.  TYRE  or  REPORT  a  PERIOD  COVEREO 

Technical  ^ep0kt  / 

s.  performing  orb.  report  number 

■J.  contrACt  oi  orAnV  mumAIrt*) 

^  NlfoOl 4-75-0-0^267^ 

io.  Program  clement,  project,  task 

AREA  A  WORK  UNIT  NUMBERS 

NR-047-143 


\  it.  report  oats 


is.  number  of  paoes 


WW1 


1».  SEC  U  RiTY  CL  ASS.  (oTiftl Ti 


lA  OCCLAS£lFICATI9N/DO«NORADtNO 
SCHEDULE 


IS  OISTfttluTtOM  STATEMENT  (of  Me  ftipwO 


I  This  document  has  been  approved  for  public  release  and  sale; 
,  Its  distribution  Is  unlimited. 


[  IT.  0*STRIRUTI0N  5'  ATEMENT  (ml  Oim  afcalncf  Mlmtf  In  HMt  H,  It  mttmtrnnt  Na  Rapari; 


>  It.  supplementary  notes 


IS.  KEY  WORDS  (Contlmim  an  nwh  iIA  II  ihcm 

NUMBER  OF  PIVOTS 
EXPECTED  ITERATIONS 
SIMPLEX  METHOD 


>  ant  l+mlltr  tp  Mm*  —If) 

LINEAR  PROGRAMMING 
OPERATIONS  RESEARCH 


ISO.  ABSTRACT  fCiHAma  «R  w»ww  <M>  W  aiMWT  mi  IR»II»  »f  M— *  RM>K) 


Please  see  attached. 


00  «  jm"s  1473  EOITION  OF  •  NOV  St  It  OBSOLETE 

S/R  OIOI-OM-  (SOI 


UNCLASSIFIED 

iCURlTY  CLAttiriCATtON  OP  TMIS  Pti 


ILS1 

*m  hNN« 


EXPECTED  NUMBER  OF  STEPS  OF  THE  SIMPLEX  METHOD 
FOR  A  LINEAR  PROGRAM  WITH  A  CONVEXITY  CONSTRAINT 


GEORGE  B.  DANTZIG 

Abstract 

When  there  is  a  convexity  constraint ,  EXy  =  1,  each  iteration  t  of  the 
simplex  method  provides  a  value  zt  for  the  objective  and  also  a  lower  bound 
zt  —  wt.  The  paper  studies  (1)  the  expected  behavior  of(iut/w0),  (2)  probability  of 
termination  on  the  t  —  th  iteration,  and  (3)  the  expected  number  of  steps,  (ITER, 
when  the  columns  are  drawn  from  a  distribution  from  a  three  parameter  class 
of  distributions.  Using  estimates  based  on  a  random  like  behavior  for  covering 
simplices,  it  is  shown  that 

( ITER  <  m[ 2.8  -f  log,(M2)  +  (2.8//) log, it),  *,  >  1 , 

where  n  —  n-f-  m-\- 1  is  the  number  of  non-negative  variables,  m-f  1  the  number  j 
of  equations.  $i  and  f  are  parameters  for  varying  the  distribution. 

Reasonable  bounds  for  1.5  <  9\92  <  4.  The  critical  parameter  is  /  >  0. 
Poor  performance  can  be  expected  if  f  <<  1.  For  9\92  =  4,  and 


/  —  1  : 

/  =  m/2  : 


( ITER  <  4.2 m  +  2.8m log  It, 
(ITER  <  4.2 m  +  5.5  log  fi . 


It  is  conjectured  that  f  =  m/2  may  be  typical  of  practical  problems.  If  so,  for 
large  m  and  W  <  some  fixed  multiple  of  m,  ( ITER  <  4.2  m  iterations  as  m  -*■  oo. 
Tighter  bounds  for  m  <  5000,  n  <  4m  are  tabulated.  For  m  =  1000,  n  <  4000, 
and  f  =  m/2,  (ITER  <  1.5  m. 
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